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The development of intercultural competence is increasingly being per¬ 
ceived as a key goal in todays education. As a result of a strong emphasis 
on that competence in curricular documents, teachers are faced with de¬ 
manding tasks. Confirming this, recent research in the field of intercul¬ 
tural competence in Croatian schools indicates the numerous difficulties 
teachers face in accomplishing the goal of developing their pupils’ inter¬ 
cultural competence. Teacher professional development can be crucial for 
a systematic approach to the development of learners’ intercultural com¬ 
petence. Therefore, the aim of this study was to determine whether teach¬ 
er participation in a further professional development programme on 
the topic of intercultural competence can significantly affect the achieve¬ 
ment of goals set in the current curricular documents on foreign language 
learning related to intercultural competence. The effects of the profession¬ 
al development programme were assessed by means of analysing learner 
outcomes in intercultural competence prior to and after teacher partici¬ 
pation in the programme. A quasi-experimental pre-test-post-test design 
was used, and the achievements of 752 primary and lower secondary level 
pupils attending 4 th and 8 th grades were evaluated. The results confirmed 
that foreign language teacher professional development in the field of in¬ 
tercultural competence had positive effects on pupils’ learning outcomes, 
especially in the cognitive component of intercultural competence. This 
leads to the conclusion that it is necessary to motivate foreign language 
teachers to participate in such programmes. The results also indicate the 
necessity of placing particular emphasis on the problem of stereotypes 
and prejudices when designing such programmes. 
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Ucinki profesionalnega razvoja uciteljev nemscine 
na ucne dosezke ucencev s podrocja medkulturnih 
kompetenc 


Ana Senjug Golub 


Razvijanje medkulturnih kompetenc je vedno bolj v ospredju kot 
kljucen cilj v danasnjem izobrazevanju. Glede na to, da je ta kompe- 
tenca mocno prisotna v kurikularnih dokumentih, se ucitelji srecujejo z 
zahtevnimi nalogami. To potrjujejo tudi novejse raziskave na podrocju 
medkulturnih kompetenc v hrvaskih solah, ki kazejo na stevilne tezave, 
s katerimi se ucitelji spopadajo pri doseganju cilja - pri ucencih raz- 
viti medkulturne kompetence. Uciteljev profesionalni razvoj je lahko 
kljucnega pomena pri sistematicnem pristopu k razvijanju medkul¬ 
turnih kompetenc ucencev. Zato je namen te raziskave ugotoviti, ali 
lahko udelezba uciteljev v programih profesionalnega razvoja na temo 
medkulturnih kompetenc pomembno vpliva na doseganje ciljev, postav- 
ljenih v obstojecem kurikulumu za poucevanje tujega jezika, povezanih 
z medkulturnimi kompetencami. Ucinki programa profesionalnega raz¬ 
voja so bili merjeni s pomocjo analiziranja ucnih dosezkov s podrocja 
medkulturnih kompetenc, preden so se ucitelji udelezili programa in 
po udelezbi. Uporabljena je bila metoda kvazieksperimenta (predtest/ 
potest). Analizirani so bili dosezki 752 ucencev, ki so obiskovali cetrti in 
osmi razred osnovne sole. Rezultati so potrdili, da je imel profesionalni 
razvoj uciteljev tujega jezika s podrocja medkulturnih kompetenc pozi- 
tiven vpliv na dosezke ucencev, se posebej glede kognitivne komponente 
medkulturnih kompetenc. To vodi do sklepa, da je ucitelje tujih jezikov 
nujno treba motivirati, da se udelezujejo tovrstnih programov. Rezultati 
kazejo tudi na to, da je pri snovanju tovrstnih programov treba se poseb- 
no pozornost nameniti tezavam, povezanim s stereotipi in predsodki. 

Kljucne besede: analiza ucnih dosezkov, ucenje in poucevanje 
nemscine, medkulturne kompetence, profesionalni razvoj uciteljev 
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Introduction 

The global economy, the establishment of worldwide connections bet¬ 
ween people and or institutions, as well as economically and socially motivated 
migration, are characteristic occurrences of contemporary societies and contri¬ 
bute to the increasing heterogeneity of various aspects of human life. In order 
to sustain oneself, thrive and actively participate in such a society, individu¬ 
als need a set of different competences. Intercultural competence is often sin¬ 
gled out as an important component of that set, its purpose being to establish 
and improve relationships and bring about mutual understanding and respect 
among members of different cultural and social groups. The development of 
this competence is increasingly being perceived as a key goal in today’s edu¬ 
cation. Official recognition of its importance in education at the European le¬ 
vel was confirmed by its inclusion in the Recommendation 2006/962/EC of the 
European Parliament and of the Council of 18 December 2006 on key competences 
for lifelong learning (Official Journal L 394 of 30.12.2006). 

The development of key competences is regarded as a relevant goal both 
in the European Union’s education policy and in the national education poli¬ 
cies of European countries. Therefore, key competences are increasingly being 
included in the national curricula throughout Europe. Similarly, intercultural 
competence is incorporated in the curricula of most European countries today, 
with foreign language teaching representing a significant area of its develop¬ 
ment (see Languages and Cultures in Europe, 2006). 

The Republic of Croatia is not an exception in following this trend, as 
the document on Key competences for lifelong learning - a European referen¬ 
ce framework has exerted significant influence on the design of the Croatian 
National Curriculum Framework for Preschool Education, General Compulsory 
and Secondary School Education (2010) (hereafter: National Curriculum Frame¬ 
work). Intercultural competence is integrated into the National Curriculum Fra¬ 
mework and is thus recognized by the Croatian education policy and language 
teaching methodology as an essential key competence. While this competence 
was defined as a foreign language teaching goal in the Primary School Curricu¬ 
lum of the Republic of Croatia as early as 2006, its achievement is more elabo¬ 
rately defined in the subsequently adopted National Curriculum Framework. 
Therefore, the competence has been given a significant position in the Croatian 
curricular documents. The development of intercultural competence is preci¬ 
sely defined and outlined in the foreign language teaching framework, and the 
competence is also - implicitly or explicitly - cited as a goal in other education 
areas and subject-integrated fields of study. 
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As a result of the placement of a strong emphasis on intercultural com¬ 
petence in curricular documents, teachers are faced with demanding tasks. In 
the Croatian education system, foreign language teachers are affected by the 
changes the most significantly, because intercultural competence is regarded as 
an essential component of foreign language competences. The accomplishment 
of the learning outcomes, such as the ability to reflect on the phenomena of‘the 
culture of the interlocutor without making value judgments’ (National Curri¬ 
culum Framework, 2010, p. 89) or the ability to reflect on the influence of‘one’s 
own culture on the perception of both the culture of the interlocutor and one’s 
own, on the ways in which culture affects communication and cultural patterns, 
and on heterogeneity, change and development as important aspects of culture’ 
(National Curriculum Framework, 2010, p. 89) can present teachers with chal¬ 
lenges. Recent research in that field confirms these assumptions. 

Research results in the field of intercultural competence in Croatian 
schools point to the numerous difficulties teachers face in accomplishing lea¬ 
rner outcomes in this area, i.e. they indicate that the approach to the develop¬ 
ment of this competence has not been sufficiently systematic (see Breka, 2012; 
Filipan-Zignic, 2008; Legac, Mikulan, & Sirocic, 2007; Senjug, 2008). The re¬ 
sults of research conducted in Croatian elementary schools, i.e. among pupils 
at primary and lower secondary school levels, 2 show evident shortcomings in 
relation to different aspects of pupils’ intercultural competence. Filipan-Zig¬ 
nic (2008) identifies significant deficiencies in the area of specific cultural and 
civilizational knowledge and concludes that such topics are neglected in fo¬ 
reign language teaching. Senjug’s (2008) research carried out among German 
language learners shows that the harbouring of prejudice toward German 
language speakers is not necessarily significantly lessened with increased 
durations of target language study. Such results indicate that cultural aspects are 
not given sufficient attention in foreign language teaching, i.e. that the changes 
introduced in the curricular documents are not sufficiently considered in the 
teaching practice (see Legac, Mikulan, & Sirocic, 2007). Although future and 
in-service teachers frequently express a positive attitude toward the develop¬ 
ment of intercultural competence and consider it to be an important goal in fo¬ 
reign language teaching (Pirsl, 2011; Breka, 2012), they often do not cover inter¬ 
cultural topics in their own classes. This is confirmed by some findings by Breka 
(2012), according to whom most of the teaching time in the foreign language 
classroom is dedicated to the development of language competences (Breka, 


2 In the Croatian education system, compulsory education comprises eight years of schooling 
and is organized in elementary schools. Grades 1-4 make up the primary, and grades 5-8 of 
elementary schools the lower secondary level, as referred to in this paper. 




C-E-P-S Journal | Vol.4 I N°4 I Year 2014 


2012, p. 249). In this respect, teachers frequently report on their shortcomings 
in the field ofintercultural competence as an obstacle to its development among 
their pupils (Breka, 2012, p. 251). While teacher professional development in the 
given field could be very useful, Brekas (Breka, 2012, p. 213) findings show that 
more than two thirds of teachers have never attended seminars on intercultural 
competence development. It is important to note that those teachers who have 
participated in such seminars and workshops consider such forms of training 
very useful. In addition, the majority of teachers are of the opinion that the 
development of intercultural competence should be given more attention than 
is currently the case (Breka, 2012, pp. 217-218). 

With regards to the presented research results, it is evident that teachers 
face difficulties in achieving the aims related to intercultural competence in the 
classroom. One possible reason for this is surely the fact that the relevant topics 
are not covered in teacher initial education. Further professional development 
can be the key to improving the teaching of those teachers who are already 
in service and are attempting to cope with education policy changes. Teachers 
themselves also consider continuing professional development to be crucial for 
the systematic development of learners’ intercultural competence (Breka, 2012, 
p. 219). 

The development of teacher competences, teaching quality improve¬ 
ment and the improvement of the learning outcomes are the central goals of 
teacher continuing professional development (Croatian Education and Teacher 
Training Agency, 2013). Forms of teacher education and professional deve¬ 
lopment are varied and range from those directed at developing work-speci¬ 
fic competences to individual learning and different formal education courses 
in higher education institutions. Teacher professional development comprises 
“talks and discussions with colleagues, study of specialist literature, participa¬ 
tion at symposia, working visits, participation in distance-learning courses, in 
scholarship programmes and in research” (Petljak Zekic, Rukljac, & Urek, 2013, 
p. 18). Forms of teacher professional development have changed over time. As 
opposed to the traditional model, in which teachers usually attended symposia 
and listened to plenary talks in large groups, modular training courses are more 
frequently offered today. Such courses enable participants to work in small te¬ 
ams and engage in an in-depth study of specific topics in the course of a few 
meetings or modules (Petljak Zekic, Rukljac, & Urek, 2013, p. 18). In this way, 
single in-service training courses are abandoned in favour of extended, more 
comprehensive, study-oriented programmes (Vujicic, 2007). 

Given that the effects of teacher professional development are reflected 
in the learning outcomes of pupils, such outcomes are indicative of the quality of 
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teacher professional development programmes. For this reason, learner achie¬ 
vements are frequently the subject of research aimed at assessing the quality of 
teacher education and continuing professional development (see e.g. Angrist 
& Lavy, 2001; Domovic & Godler, 2005; Jacob & Lefgren, 2004; Shah & Alam, 
2002). A great number of such studies indicate the weak spots of in-service 
teacher training (Kennedy, 1998) and identify low intensity or small amounts of 
input and a lack of continuity of professional development programmes as the 
main problems (Corcoran, 1995; Little, 1993). In contrast, some studies show 
that high quality in-service teacher training positively affects students’ learning 
outcomes (Angrist & Lavy, 2001; Little, 1993). 

In view of the difficulties faced by foreign language teachers in relati¬ 
on to achieving intercultural competence as a learning outcome and given the 
relevance of teacher’s continuing professional development, the aim of this 
study was to determine whether teacher participation in professional develop¬ 
ment courses on the topic of intercultural competence can significantly affect 
the achievement of goals set in the current curricular documents on foreign 
language learning. Therefore, the purpose of this study was to ascertain the 
influence of German language teacher professional development in the field of 
intercultural competence on the outcomes defined as goals in the foreign lan¬ 
guage curricular documents. The effects of teacher professional development 
were assessed by examining learner outcomes in intercultural competence, pri¬ 
or to and after teacher participation in a specially designed teacher professional 
development programme. In order to define the subject area of teacher further 
professional development and set the guidelines for learner outcome evaluati¬ 
on, a definition of intercultural competence in the framework of foreign langu¬ 
age teaching shall be given first. 

Intercultural competence in foreign language teaching 

The complexity of the construct of intercultural competence currently 
lacks a uniform definition. Attempts to convey the complex aspects of the con¬ 
cept are exemplified in a range of various terms currently in use. While no over¬ 
lapping of terms was noted in the German language sources, studies written 
in English promote a variety of synonymously used expressions, such as cross- 
cultural awareness, global competitive intelligence, cultural competence, cultural 
sensitivity, ethno-relativity, international competence, intercultural interaction, 
biculturalism, multiculturalism, etc. (Fantini, 2006, p. 81; Mertesacker, 2010, p. 
26; Yussefi, 2011, p. 16). Emphasis is laid on global knowledge in one term, sen¬ 
sitivity is in the focus of another, specific skills are singled out in yet another. 
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and so on. In spite of the focal differences of the said concepts, a consensus 
across disciplines exists on the three essential components of intercultural com¬ 
petence: the cognitive (knowledge), the affective (attitudes and beliefs) and the 
pragmatic (skills) component (Gehrmann, Petravic, & Senjug Golub, 2013). 

These components form part of Byram’s (1997) model of intercultural 
communication competence. His model is very well accepted in foreign lan¬ 
guage learning and teaching, and has significantly influenced the way in which 
intercultural competence is defined in both the Common European Framework 
of Reference for Languages (Council of Europe, 2001) and in the Croatian Nati¬ 
onal Framework Curriculum (see Petravic, 2011). This competence is regarded 
as an important aspect of Byrams model of intercultural communication com¬ 
petence, which consists of intercultural, linguistic, sociolinguistic and discur¬ 
sive competence. Intercultural competence itself comprises five components: 

• knowledge (fr. savoirs), 

• attitudes (fr. savoir etre ), 

• skills of discovery and interaction (fr. savoir apprendre/faire), 

• skills of interpreting and relating (fr. savoir comprendre ), and 

• critical cultural awareness/political education (fr. savoir s’engager). 

The knowledge one brings into interaction with individuals from anot¬ 
her country, i.e. with interlocutors perceived as different from oneself, com¬ 
prises two categories. One is the category of the knowledge of social groups 
and culture in one’s own as well as one’s interlocutor’s country; the other is the 
knowledge of the processes of interaction, referring to the ways in which social 
identity is acquired and to the awareness of that identity’s acting as a prism 
through which one is perceived by others. The prism also determines the way 
in which members of other groups are perceived by us (Byram, 1997, pp. 35-37). 

Skills of interpreting and relating originate in the knowledge of one’s own 
environment and the environment of another, and are not limited to interac¬ 
tion with others, but are also applied when faced with any kind of document 
from another culture. Skills of discovery and interaction are activated when one’s 
knowledge in interaction with another is limited or entirely lacking. This di¬ 
mension relates to the ability of acquiring specific knowledge and the unders¬ 
tanding of beliefs and behaviour behind a given phenomenon, be it a document 
or a person in interaction (Byram, 1997, pp. 37-38). 

Critical cultural awareness partially covers the remaining dimensions 
of Byram’s model. It refers to the ability to critically reflect on the perspecti¬ 
ve, the customs and the products of one’s own and one’s interlocutor’s culture. 
The aim of such reflection is not exclusively limited to achieving more efficient 
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communication, but also involves bringing to light the ideological side of one’s 
own perspective (Byram, 1997, pp. 63-64). 

Attitudes are a prerequisite of successful intercultural competence, with 
desirable attitudes being those marked with curiosity and openness toward ot¬ 
hers, readiness to suspend disbelief and respect for others’ beliefs and beha¬ 
viour. Furthermore, it is important that one’s attitude expresses a readiness to 
observe one’s own culture from the viewpoint of the interlocutor and critically 
reflect on one’s own values (Byram, 1997, pp. 34-35). 

Byram’s (1997) model of intercultural competence is often applied in the 
design of instruments for the evaluation of foreign language teaching (see Aijala, 
2009; Eberhardt, 2009; Feng & Fleming, 2009; Sercu, 2000). While all but one 
component of intercultural competence can, according to Byram, be assessed 
directly, critical cultural awareness (fr. savoir s’engager ) is assessed indirectly via 
other components. Byram does not regard holistic evaluation as possible, becau¬ 
se each component requires a particular mode of assessment. He cites four such 
assessment modes: portfolio, test, simulation and continuous assessment. Some 
of these procedures can also be applied when evaluating more than one dimensi¬ 
on of intercultural competence. For instance, knowledge (fr. savoirs ) of the target 
culture in terms of the knowledge of the products, events and phenomena, can 
be assessed via tests and continuous assessment (Byram, 1997, p. 98). The most 
appropriate means of assessment for attitudes marked with openness, curiosity 
and readiness to suspend disbelief related to one’s own and one’s interlocutor’s 
culture ( savoir etre ) is the portfolio (Byram, 1997, p. 95), while skills of discovery 
and interaction (fr. savoir apprendre/faire), which enable students to act as inter¬ 
mediaries between cultures and independently look for and evaluate informa¬ 
tion on a foreign culture, can be assessed via tests, simulations and portfolios. 
Skills of interpreting and relating (fr. savoir comprendre), at work in interaction 
and in contact with any kind of foreign content, can be assessed through tests 
and continuous assessment (Byram, 1997, p. 102). While Byram names the pro¬ 
cedures applicable for evaluation, he does not tackle the questions of actual tests, 
the kinds of tasks needed and the particular target groups of respondents, except 
in the case of portfolio. Furthermore, there are other aspects that make the car¬ 
rying out of certain assessment modes difficult and need to be considered in the 
evaluation. They may include the specifics of the school environment, such as 
the cognitive-affective level of child development, individual pupil assessment 
in groups and the time and staff constraints. Nevertheless, Byram’s framework 
outline enables the design of actual evaluation instruments adapted to the speci¬ 
fics of school context and evaluation purpose and aimed at assessing particular 
groups of respondents (see Aijala, 2009). 
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Considering the usefulness of Byrams model of intercultural compe¬ 
tence in foreign language teaching, its widespread acceptance and the possibili¬ 
ties of its implementation in the field of intercultural competence assessment, 
it serves as the basis of the research presented here. The following part of the 
paper deals with the individual steps and the results of the study. 

Method 

The research was conducted in three phases: 3 

1. An initial evaluation was conducted at the beginning of the school year 
in all treatment and control groups. 

2. Teachers teaching treatment groups participated in three day-long 
teacher professional development modules with the topic of intercul¬ 
tural competence during one school year. 

3. Final evaluation was conducted at the end of the school year in all re¬ 
spondent groups. 

Teacher professional development was carried out in the form of mo¬ 
dules over the course of one school year. Five teachers of German as a foreign 
language took part in the programme during the 2009/2010 school year, and 
six during 2010/2011. The programme was conducted in three modules: at the 
start of the school year, at the end of the first semester and during the second 
semester. The first module focused on two aspects the theoretical background 
and practical exercises in the form of workshops. The aims of the first module 
were to gain awareness of the importance of intercultural competence, to dee¬ 
pen the knowledge of the concept and the models of intercultural competence, 
to become acquainted with the outcomes of teaching aimed at the development 
of intercultural competence, and to learn and carry out the activities for the 
development of the competence among pupils. The activities 4 were specially de¬ 
signed in the framework of the aforementioned project or modified according 
to the relevant literature and adapted to the pupils’ ages and the Croatian school 
context. In addition to deepening acquired knowledge, the next two modules 
focused on the teachers’ reflection on the effects of their work based on the 
classroom examples and the exchange of participants’ experiences. In this way, 


3 Research was conducted in the framework of the research project Development of intercultural 
competence in primary foreign language teaching (MZOS RH, 227-2271168-0726) under the 
supervision of prof. dr. sc. Ana Petravic). 

4 The activities were published as a collection of materials on IC as a learning outcome of young 
and teenage learners, under the title Aufdem Wegzum interkulturellen Sprecher (On the way to 
the intercultural speaker ) (Petravic & Senjug Golub, 2012). 
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the teachers kept a record of the intercultural activities they conducted during 
the school year, of their observations on the individual steps in the implemen¬ 
tation of activities, of their pupils’ reactions and the difficulties encountered, as 
well as of the possible solutions. Some difficulties were noted regarding the level 
of pupils’ language competence, the discussions of sensitive issues, the comple¬ 
xity of some issues as exemplified in the concepts of value, cliche, stereotype 
and the like, the problem of perspective change, etc. Reports of pupils’ positive 
reactions were frequently made and refer to the pupils’ awareness of particular 
problems, their perception and acceptance of mutual differences, their abilities 
to connect certain topics with their own experiences, their openness and curi¬ 
osity in learning about a foreign culture and positive changes in the relations¬ 
hips between pupils in class. 

Assessment of the effect of the teacher professional development prog¬ 
ramme on the learning outcomes of pupils was conducted in fourth and eighth 
grades, i.e. at the end of primary and lower secondary education, respectively. 
Evaluation of learner outcomes (a paper-and-pencil procedure) in the duration 
of one school period was deemed to be an appropriate mode of assessment. The 
main shortcomings of paper-and-pencil evaluation procedures are their failure 
to take into account the pupils’ state of mind at the time of testing and the lack 
of the possibility to ask additional questions. This makes it quite difficult to gain 
better insight into pupils’ reasoning. Despite these shortcomings, written evalu¬ 
ation methods are often deemed the most appropriate type of evaluation in the 
school context. They have the highest objectivity level due to minimal interac¬ 
tion between evaluators and respondents. In addition, they are the most practi¬ 
cal, as the assessment time is minimal, and group testing can be conducted with 
a large number of pupils. Furthermore, as the financial costs are minimal, they 
can be conducted by classroom teachers (see Barenfanger & Stevener, 2009.). 

A pre-test-post-test intergroup quasi-experimental design was applied, 
and distinct emphasis was placed on the similarity between the control and tre¬ 
atment group in the dependent variable. This means that in order to successfully 
ascertain the effects of teacher professional development at the end of the expe¬ 
riment, it was vital that the pupils in both the treatment and the control groups 
accomplished similar pre-test results in their level of intercultural competence. 

The aim and hypothesis 

The aim of this survey was to determine the effects of German language 
teacher professional development in the field of intercultural competence de¬ 
velopment on the pupil intercultural competence learning outcomes through 
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the assessment before and after the teachers’ participation in a particular pro¬ 
fessional development programme. The following problem is derived from the 
stated aim: 

To evaluate the differences in the level of fourth (primary) and eighth 
grade (lower secondary) pupils’ intercultural competence in relation 
to their teachers’ participation in the professional development pro¬ 
gramme on intercultural competence development. 

The following hypothesis was proposed: 

H: Teacher professional development will have positive effects on pupils’ learning 
outcomes in intercidtural competence. 

Pupils in the treatment group were exposed to a particular process of 
intercultural competence development in such a way that their teachers carried 
out certain actions and activities and covered the topics studied in the profes¬ 
sional development modules. The topics covered were dealing with everyday 
life from the intercultural viewpoint. Also included were specific topics, such 
as intercultural misunderstandings, preconceptions and stereotypes, cultural¬ 
ly influenced communication, etc. The choice of activities comprised specific 
tasks related to intercultural learning, such as tasks developing perception, the 
abilities of estimating culturally conditioned patterns and the ability of inter¬ 
cultural comparison. 

This by no means implies that the pupils from the control groups did 
not receive any treatment at all, i.e. that their teachers did not cover the topics 
and activities aimed at the development of intercultural competence as defined 
in the teaching curriculum. However, it is assumed that such topics are usually 
not given a significant amount of time or focused on significantly in class and 
that they are frequently narrowed down to factual knowledge of culture and 
civilization of the countries of the German-speaking area (see Petravic, 2010). 
It was, therefore, expected that the pupils in the treatment groups would, due to 
their more intensive and structured exposure to the said topics, achieve higher 
post-test scores as a direct result of their teachers’ professional development. 
The hypothesis comprises the following sub-hypotheses: 

Hi: Pupils in the treatment groups will achieve higher scores in the area of 
knowledge about the culture and civilization of the German-speaking area. 
H2: Pupils in the treatment groups will achieve higher scores in the area of 
specific intercultural skills. 

H3: Pupils in the treatment groups will express more desirable attitudes toward 
individuals from the German-speaking area. 
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Respondents 

Respondents in this survey were fourth and eighth grade pupils of pri¬ 
mary and lower secondary school. The sample comprised a total of 37 classes of 
pupils learning German as the first foreign language. A total of 13 schools from 
6 counties took part in the survey (see Figure 1); 28% of the total number of 
respondents come from rural areas, 6% from small urban areas (up to 10,000 
inhabitants), 6% from mid-sized towns (10,000 to 100,000 inhabitants) and 
60% from large urban areas (more than 100,000 inhabitants). 
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Figure 1. Number of respondents in the initial and the final evaluation 
according to county, shown in percentages 


The initial evaluation was conducted at the beginning of the 2009/2010 
school year in the fourth grade and at the beginning of 2010/2011 in the eighth 
grade. A total of 751 respondents, of which 397 (52.86%) were girls and 349 
(46.47%) boys, participated in the pre-test. Five (0.66%) respondents left their 
gender unmarked on the pre-test. There were 323 (43%) respondents in the 
treatment group and 428 (56.99%) in the control group; 355 respondents at¬ 
tended the fourth and 396 the eighth grade. The final evaluation in the fourth 
grade was conducted at the end of the 2009/2010 school year, and in the eighth 
grade at the end of 2010/2011. A total of 752 respondents (386 (51.33%) girls and 
366 (48.67%) boys) took part in the post-test. The treatment group was repre¬ 
sented by 321 (42.69%) and the control group by 431 (57.31%) respondents; 360 
respondents were fourth grade and 392 eighth grade pupils. 
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Instruments 

An intercultural competence evaluation instrument was designed for 
the pupils in the fourth grade and the eighth grade. The design was based on 
Byram’s (1997) model of intercultural competence, which was adapted for the 
specifics of the Croatian school environment, the current curricular docu¬ 
ments and the level of pupils’ cognitive-affective development. The compo¬ 
nents of intercultural competence relevant for the target group were integrated 
into a threefold structure of the questionnaire. It represents a battery of instru¬ 
ments assessing the cognitive, affective and pragmatic aspects of intercultural 
competence. 

The first part of the instrument assesses the knowledge of the culture and 
civilization of the German-speaking area, i.e. culturally specific knowledge (By¬ 
ram, 1997). The content of the test questions was adapted to the German langu¬ 
age curriculum. Respondents were given a set of open questions in which they 
were asked to name the facts and the phenomena of the target culture such as 
information in relation to geography, history, science, humanities, arts, behavi¬ 
our, customs and ways of communicating and behaving. 

The second part of the instrument evaluates skills, primarily the skill of 
relativizing the foreign culture as well as one’s own, the skill of gathering infor¬ 
mation and the skill of interpreting and interacting. Therefore, this part of the 
instrument covers individual competence areas of the skill of discovery and 
interaction (fr. savoir apprendre/faire ) and the skill of interpreting and relating 
(fr. savoir comprende) (Byram, 1997). These specific skills were investigated by 
means of the completion of associative sequence tasks and the tasks of descri¬ 
bing reactions to problem situations similar to some probable real situations. 
This part of the instrument was designed on the basis of previous research and 
the instruments used therein, primarily those related to the school context (see 
Aijala, 2009; Brym, 2004; Hesse & Gobel, 2006; Pachevska, 2003), as well as the 
instruments of the INCA project (www.incaproject.org). 

The third part of the instrument examines pupils’ attitudes by means of a 
five-point scale measuring three sub-dimensions of attitudes toward members 
of the culture of the German-speaking area: curiosity/disinterest, openness/ 
lack of openness and inclination/disclination to stereotypes and preconceptions 
(see Byram, 1997, p. 35, 50, 91). The items were based on the instrument of the 
previously conducted survey of learner attitudes toward Germans (see Senjug, 
2008). Although the affective dimension of intercultural competence comprises 
the positive attitudes toward all people perceived as different from ourselves, 
this study focused on the specific context of German language teaching and was 
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based on the curriculum of German as a foreign language (see Primary School 
Curriculum, 2006). For this reason, only the attitudes related to the members 
of the target culture were investigated. 

Data processing 

Metric characteristics of the instrument were assessed upon conducting 
the research. To test the validity, an item discrimination index was used. Mutual 
relatedness between the three parts of the instrument (knowledge (1), skills (2) 
and attitudes (3)) and the correlation of success on each part of the instrument 
with external variables of school success was measured using the Pearson cor¬ 
relation coefficient. In the attitudes part of the instrument, an exploratory fac¬ 
tor analysis using the principal component method was conducted to test the 
assumption of the three sub-dimensions of attitudes toward members of the 
foreign culture. The reliability of the instrument was examined by determining 
the internal consistency using Cronbach’s alpha. In order to examine the sensi¬ 
tivity, the acquired range and the items difficulty index were analysed. 

It can be stated that the metric characteristics of all three parts of the 
instrument (knowledge, skills and attitudes) are satisfactory as a whole. The 
acquired range in all parts of the instrument greatly correlates with the pos¬ 
sible theoretical range. All the questions in the parts of the instrument covering 
knowledge and skills have good item discrimination (r. > 0.35). Factor analysis 
of the third part of the instrument confirmed the assumption of the three sub¬ 
dimensions of attitudes. Cronbach’s alpha coefficient is in the range between 
0.668 and 0.879 in individual parts of the instrument. All three parts of the 
instrument are mutually well correlated and in line with pupils’ grades in the 
subject of German language, which points to the instrument’s validity. 

A T-test and Mann-Whitney U test were applied to test the differences 
in the level of pupils’ intercultural competence development in relation to their 
participation in the experimental programme, i.e. in order to test the hypoth¬ 
eses. Data analysis was conducted using SPSS for Windows. 

Results 

The results are shown in two segments. The first part deals with the pre¬ 
test results, where the focus lies on the assessment of similarities between the 
control and the treatment group in the dependent variable. The second part 
shows the post-test results and the differences between the control and the 
treatment group in relation to the level of intercultural competence. 
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Initial evaluation 

As already stated, the similarity between the treatment and the control 
group in the dependent variable is essential in order to be able to reach viable 
conclusions after the experiment completion. For the purpose of identifying 
possible differences between the fourth grade control and treatment group in 
relation to the results accomplished in the area of knowledge and skills, an in¬ 
dependent samples t-test was conducted. As the data in the area of attitudes 
do not follow the normal distribution, a nonparametric Mann-Whitney U 
test was conducted. The results obtained indicated the absence of statistically 
significant differences between the control and the treatment group regarding 
the results obtained in the area of knowledge (t=0-702, p=o.483) and skills (t=- 
1.669, p=o.096). This confirms that the two groups were equal with regard to 
their knowledge of culture and civilization of the countries of the German¬ 
speaking area and that the members of both groups were equal in their achieve¬ 
ment of intercultural skills. Therefore, upon completion of the experimental 
programme, conclusions can be drawn on the programme’s influence on the 
treatment group. 

The absence of a statistically significant difference between the treat¬ 
ment and the control group in view of the respondents’ lack of openness toward 
individuals from the German-speaking area and in view of their inclination to 
stereotypes was confirmed in the area of attitudes 5 (see Table 1). However, the 
groups differed in the level of curiosity, with the treatment group having a high¬ 
er mean rank in this respect than the control group (marked bold in Table 1). 

Table 1. Mann-Whitney U test for independent samples -pre-test results of 4th 
grade pupils’ attitudes 



Group 

N 

Mean Rank 

U 

Z 

P 

Curiosity 

Treatment 

116 

153.94 

7257.500 

-2.951 

.003 

Control 

158 

125.43 




Lack of openness 

Treatment 

100 

112.11 

6161.000 

-1.596 

.110 

Control 

140 

126.49 




Inclination to 

Treatment 

117 

140.50 

8951.000 

-.449 

.653 

stereotypes 

Control 

158 

136.15 





N - number of participants, U - Mann-Whitney U value, z - z value, p - statistical significance 


5 Three aspects characterising attitudes toward members of the target culture (curiosity, lack 
of openness and inclination to stereotypes) were identified by submitting the part of the 
instrument relating to attitudes to factor analysis. These findings are in line with the theoretical 
framework (see also Byram, 1997). 
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For this reason, it would not be possible to compare the groups in view 
of the said component of attitudes after post-test. Nevertheless, it can generally 
be said that in relation to the result of the pre-test, the treatment and the control 
group are quite similar, with a slight difference in one segment of attitudes. 

In spite of the lack of normal distribution of data in the intercultural 
competence in the eighth grade pre-test, the analysis of kurtosis, skewness 
and modality of distribution shows that it was possible to use the parametric 
procedure for the comparison of the treatment and the control group in all 
parts of the instrument. An independent sample t-test was applied, and the 
results obtained showed the absence of a statistically significant difference be¬ 
tween the control and the treatment group in the results achieved in the area 
of knowledge (t=o.243, p=o.8o8), skills (t=i-542, p=o.i24) and attitudes - curi¬ 
osity (t=i.077, p=o.282), lack of openness (t=-o.977, p=o.329) and inclination 
to stereotypes (t=-o.i95, p=o.845). This shows that the two groups are equal 
in all the evaluated segments of intercultural competence. Therefore, both the 
conducting of the experiment and the conclusion drawing upon post-test are 
valid procedures. 

Final evaluation 

The aim of the final evaluation was to ascertain the differences between 
the treatment and the control group in view of respondents’ level of individu¬ 
al components of intercultural competence and thus determine the effects of 
teacher further professional development in the field of intercultural compe¬ 
tence. It was expected that the treatment group respondents would, due to their 
more structured and more intense exposure to intercultural topics than that 
of the control group respondents, achieve better results in all dimensions of 
intercultural competence as a direct result of their teachers’ professional devel¬ 
opment in that field. 

In comparing the fourth grade posttest results, significant differences 
were identified between the treatment and the control group in the mean re¬ 
sults obtained in individual parts of the instrument (Table 2). It can be seen 
that the treatment group pupils achieved a mean score of 22.1 points in the 
knowledge of culture and civilization, while the control group respondents only 
achieved a score of 13.7 points in that field. The treatment group also scored 
on average three points higher than the control group in the area of skills. As 
already stated, the pretest results for attitudes showed differences between re¬ 
spondents in the factor of curiosity, with the treatment group having higher 
scores. While the control group scored 22.18, the treatment group earned a 
score of 24.31 points. The control group acquired virtually the same result on 
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the post-test, while the treatment group achieved a higher post-test score. Fur¬ 
thermore, the treatment group pupils with a lower mean result were found to be 
more open toward foreign cultures. It is interesting to note that the treatment 
group respondents scored higher in their inclination to stereotypes than those 
in the control group. However, in order to determine the statistical significance 
of the stated differences between the groups, it is necessary to conduct appro¬ 
priate statistical procedures. 


Table 2. Descriptive parameters of overall 4th grade post-test results 



Group 

N 

Mean 

Std. Dev 

Std. Error Mean 

Knowledge 

treatment 

148 

22.11 

4.818 

0.396 

control 

202 

13.71 

5.457 

0.384 


treatment 

148 

25.11 

6.942 

0.571 

Skills 

control 

202 

22.12 

7.491 

0.527 

Curiosity 

treatment 

137 

25.55 

5.485 

0.469 

control 

190 

22.74 

6.522 

0.473 

Lack of openness 

treatment 

139 

9.41 

5.127 

0.435 

control 

186 

12.69 

6.204 

0.455 

Inclination to 

treatment 

133 

24.57 

4.031 

0.350 

stereotypes 

control 

183 

23.16 

4.090 

0.302 


With the aim of determining a statistically significant difference be¬ 
tween respondents’ results in the area of knowledge and skills, an independent 
sample t-test was conducted. Table 3 shows that the above described differences 
between the groups are statistically significant, i.e. that the treatment group 
scored better in the area of specific knowledge and skills. 

Table 3. Independent-samples t-test for 4th grade respondents - the comparison of 
the treatment and the control group in the post-test results for knowledge and skills 



t 

df 

P 

Knowledge 

14.939 

348 

.000 

Skills 

3.781 

348 

.000 


df - degrees of freedom, p -statistical significance 


Because data in the segment of attitudes did not follow normal distribu¬ 
tion, a nonparametric rank-sum Mann-Whitney U test was applied to deter¬ 
mine the significance of the differences between the treatment and the control 
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group. The test was not conducted for the factor of curiosity due to the already 
mentioned difference between the control and the treatment group in the pre¬ 
test. The results confirm that the above mentioned differences are statistically 
significant (see Table 4), which means that the treatment group pupils are more 
open toward the members of the German-speaking area, but they are also more 
inclined to stereotypes in relation to the members of other cultures. There are 
a few possible explanations for this interesting finding, one of which is that 
stereotypes may have been unconsciously transferred from the treatment group 
teachers in their lessons with a stronger emphasis on the target language cul¬ 
ture and civilization. Teachers may have inadvertently transferred stereotyped 
images to pupils, who are open to accepting the attitudes from their environ¬ 
ment, this especially being true for primary school pupils (Aboud, 1988, p. 128; 
Leopold-Mudrack, 1998, p. 67). Another possible explanation of this finding 
lies in the specifics of pupils’ cognitive and affective maturation. Stereotyped 
notions are developed in pupils even before the beginning of schooling and 
are processed until the end of lower secondary education. The focus shift from 
external to internal characteristics in the assessment of people occurs with age, 
so that it is only after ten years of age that pupils more readily accept the simi¬ 
larities between themselves and the persons from other cultures (Aboud, 1988; 
Selman, 1980, in Berk, 2008). It is, therefore, possible that the pupils in the 
treatment group, who were more intensively exposed to cultural contents of the 
target language, did not filter their acquired knowledge, but used it to develop 
stereotypes, i.e. to make generalizations. It is, thus, for example, possible for the 
pupils who learn that Germany is known for its beer production, to transfer the 
acquired knowledge to the area of their own beliefs and come to believe that all 
Germans drink beer. 

Table 4. Mann-Whitney U test for 4th grade respondents - the comparison of 
the treatment and the control group in the post-test results for attitudes 



U 

Z 

P 

Lack of openness 

8496.500 

-5.399 

.000 

Inclination to stereotypes 

9335.000 

-3.546 

.000 


The results of the post-test for eighth grade respondents significantly dif¬ 
fer from those obtained in the fourth grades. If the mean results for groups in 
the post-test are compared (see Table 5), it can be seen that the control and the 
treatment group only differ in the section of knowledge. This difference is sta¬ 
tistically significant (see Table 6). 
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Table 5. Descriptive parameters of overall post-test results for 8th grade 
respondents 



Group 

N 

Mean 

Std. Dev 

Std. Error Mean 

Knowledge 

treatment 

160 

9.06 

5.507 

0.435 

control 

210 

7.91 

5.241 

0.362 


treatment 

160 

22.45 

7.781 

0.615 

Skills 

control 

210 

21.50 

9.119 

0.629 

Curiosity 

treatment 

141 

23.21 

6.169 

0.520 

control 

182 

22.47 

6.285 

0.466 

Lack of openness 

treatment 

140 

9.69 

4.850 

0.410 

control 

178 

10.13 

4.865 

0.365 

Inclination to 

treatment 

140 

22.36 

4.251 

0.359 

stereotypes 

control 

177 

22.76 

4.723 

0.355 


Although it was expected that all treatment group respondents would 
achieve better post-test results in all the tested segments of intercultural com¬ 
petence, this was not the case with the respondents from eighth grades. Slight 
differences between the control and the treatment group can be noted in the 
aspect of skills and attitudes (Table 5). However, these are not statistically sig¬ 
nificant (see Table 6). In other words, the treatment group pupils did not score 
better than the control group pupils in the area of skills and attitudes. 

Table 6. Independent-samples t-test and Mann-Whitney U test for 8th grade 
respondents - the comparison of the treatment and the control group for the 
post-test results in the dependent variable 


t-test 

t 

df 

P 

knowledge 

2.042 

368 

.042 

skills 

1.080 

368 

.281 

Mann-Whitney 

U 

Z 

P 

curiosity 

11875.500 

-1.152 

.249 

lack of openness 

11708.500 

-.934 

.351 

inclination to stereotypes 

11280.000 

-1.373 

.170 


The results show that the effect of teacher further professional devel¬ 
opment on the development of intercultural competence among eighth grade 
pupils was only evident in the cognitive aspect, i.e. in the field of specific knowl¬ 
edge of culture and civilization. It can be concluded that in the case of teenage 
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pupils, specific intercultural skills and attitudes are developed in a more com¬ 
plex way and over a longer period than among younger pupils. This conclusion 
can be based on the assumption that the attitudes of children up to a certain age 
are marked with more openness toward the world. Therefore, pupils under ten 
years of age do not possess a firmly developed system of values and attitudes, 
which is acquired in the process of socialization in one’s own culture (Leopold- 
Mudrack, 1998, p. 65). This means that the attitudes of children under ten years 
of age toward other cultures and their members will be positive or neutral at the 
least. Further development is marked with stronger acceptance of norms and 
ways of behaving typical of one’s own social circle, i.e. one’s country, so that the 
openness toward the other and that which is different from one’s own culture is 
diminished. This makes it somewhat more difficult to develop specific intercul¬ 
tural competences among lower-secondary pupils. 

Nevertheless, if we take a look at the results for fourth grade respond¬ 
ents, certain similarities with the results described for eighth grade respondents 
are evident. Although the fourth grade pupils in the experiment group achieved 
better results in almost all the tested components of intercultural competence, 
the results show that the effect of intensive and more structured dealing with 
cultural topics is the greatest in the field of knowledge. An overall conclusion 
can be given that in the teaching of intercultural competence it is more difficult 
to influence complex skills and attitudes. Furthermore, this process becomes 
more complex and develops more slowly with age. It is, therefore, possible that 
the post-primary stage is not the best time to start dealing intensely with the 
contents aimed at developing intercultural competence. 

Conclusion 

In view of the results obtained it can be concluded that the first sub-hy¬ 
pothesis (Hi) was confirmed for both fourth and eighth grade pupils and that the 
teacher professional development programme had a significantly positive effect 
on the learning outcomes in the cognitive aspect of intercultural competence. 
Furthermore, it can be said that the second sub-hypothesis (H2) was confirmed 
for fourth grade pupils, i.e. teacher professional development had a positive influ¬ 
ence on the pupil achievement in the area of skills. The second sub-hypothesis was 
not confirmed for respondents in eighth grade. Sub-hypothesis H3 was partially 
confirmed for fourth grade pupils. Teacher professional development influenced 
one segment of attitudes, i.e. pupils in the treatment group showed more desir¬ 
able attitudes in view of openness toward individuals from the German-speaking 
area. This sub-hypothesis was not confirmed for the eighth grades. 
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In view of all the given results, it can be concluded that foreign language 
teacher professional development in the field of intercultural competence has 
positive effects on the pupil’s learning outcomes, especially with younger learn¬ 
ers, as with this group of respondents the participation in the experimental 
programme yeilded better results in all the aspects of intercultural competence 
with the exception of one aspect of attitudes. Positive outcomes of the experi¬ 
mental programme were less evident among eighth grade pupils. While this 
can be a consequence of certain limitations of short-term teacher development 
programmes, it should also be noted that the development of intercultural 
competence is a lengthy and slow process, especially with regards to complex 
skills and attitudes. This is also one of the possible reasons the effects of the 
experimental programme were limited. 

In view of the complexity of the development of intercultural compe¬ 
tence at the primary and lower secondary school levels, it should be noted that 
the further professional education course provided for the needs of this study 
was limited in its duration and comprised three day-long modules. The experi¬ 
mental programme was conducted in the course of only one year. Despite this, 
teacher participation in the programme and their subsequent application of 
the knowledge and skills acquired, i.e. their teaching in experimental classes, 
had positive effects on the pupil intercultural competence development. This 
is an argument in favour of such form of further professional education pro¬ 
grammes. Nevertheless, it should be said that such programmes with a longer 
duration might give better results. 

All the results presented thus far lead to the conclusion that the effects of 
short-term teacher professional development in the field of intercultural com¬ 
petence are very useful in spite of their limitations and that it is important to 
motivate teachers to participate in them. However, bearing in mind that the de¬ 
velopment of this competence is a complex and lengthy process, it is especially 
important to motivate teachers for continued activities related to intercultural 
competence in their foreign language teaching and preferably start with the 
pupils of the youngest school age. Regarding the design of teacher professional 
development programmes in the field of intercultural competence, particular 
emphasis should be placed on the problem of stereotypes and prejudices. While 
the outcomes of this study refer to the school system of the country in which 
it was conducted, they also point to the importance of teacher education in 
the development of learners’ intercultural competence outside of the Croatian 
education system. 
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